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1.  The  article  entitled  "Improper  Use  of  Economic  Analysis  in  Materiel 
Cost  Comparison  Studies,"  scheduled  for  presentation  at  the  Department  of 
Defense  Cost  Analysis  Symposium  at  Leesburg,  Virginia,  6-8  September,  1969, 
revealed  no  classified  or  sensitive  unclassified  material.  The  material 
has  been  cleared  for  release. 
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Economic  Analyaia  <BA^)  la  defined  in  Army  Regulation  11-28  as  a  aystematic 
approach  to  the  problem  of  choosing  how  best  to  employ  scarce  resources. 

This  approach  is  an  investigation  of  the  full  Implications  of  achieving 
a  given  objective  In  the  moat  effective  manner.  Economic  analysis  Is  uclUted 
to  examine  various  altemativea  to  solve  a  probleu;  so  that  the  decision 
maker  can  select  the  beat  option.  Costs  and  benefits  for  each  alcernarlve 
are  analyzed  and  compared.  When  employed  properly,  economic  analysla  la 
a  powarful  cool  for  Che  decision  maker.  When  not  prepared  properly,  the 
EA  can  lead  to  the  wrong  decision. 

Background 

The  coat-benefit  analysis  Is  the  basis  for  reviewing  the  various  alternatives. 
This  analysis  enables  the  decision  maker  to  examine  the  costs,  weigh  the 
benefits  and  to  determine  the  feealblllty  of  implementing  each  alternative. 

All  options  which  are  not  viable  are  eliminated  from  further  consideration. 

Those  which  survive  the  initial  test  of  feasibility  are  compared  to  each 
other  showing  both  costa  and  benefits. 

The  first  consideration  In  preparing  an  EA  is  to  identify  the  problem. 

It  is  essential  to  analyze  the  problem,  define  It  and  to  consider  all  possible 
alternatives.  Alternatives  which  are  not  feasible  should  be  Immediately 
discarded.  This  procedure  avoids  time  consumed  addressing  the  wrong  problem 
or  In  developing  a  detailed  analysis  unsuitable  alternatives.  Analysis 
of  the  problem  should  be  discussed  in  a  benefit  analysla.  Proper  idencif tcstlon 
of  the  problem  and  the  potential  solutions  can  save  many  manhours  of  work. 


’Sr’  0‘r  :  4 ,  H  MVS'. I b  fK' 


Isauea 


The  overwhelming  majority  of  EA  atudies  are  prepared  with  separate  cost 
and  benefit  analyses  with  no  effort  to  link,  them  in  a  common  equation. 

This  should  not  be  construed  as  a  waakneas  for  an  economic  analysis.  However, 
the  emphasis  today  is  clearly  on  the  coat  analysis  with  sometimes  little 
or  no  effort  undertaken  to  present  a  true  benefit  analysis.  Seme  detailed 
SA  studies  are  submitted  without  any  benefit  analysis.  PRIMIRs  are  prepared 
with  only  one  or  two  paragraphs  of  benefit  analysis.  Validation  experience 
at  the  U.S.  Army  Aviation  Systems  Command  (AVSCOM)  has  confirmed  the  far 
heavier  emphasis  on  the  cost  analysis  process  with  up  to  ten  pages  of  cost 
worksheets  submitted  for  some  PRIMIRs. 

A  textbook  solution  to  the  imbalance  between  cost  analysis  and  benefi' 
analysis  is  to  combine  these  into  a  single  comparison.  Such  an  approach 
would  appear  as  an  ideal  solution  for  equating  costs  and  benefits.  However, 
this  approach  is  considerably  more  difficult  and  risky.  Care  must  be  taken 
to  quantify  benefits  in  Che  most  logical  and  reasonable  manner  ao  as  not 
to  give  one  alternative  an  unfair  advantage. 

One  of  the  major  tasks  of  esch  Major  Subordinate  Command  (MSC)  is  the 
preparation  of  PRIMIRs.  Over  180  PRIMIRs  were  submitted  for  validation 
at  AV8CW1  during  the  second  quarter  or  PY  89. 

Recent  PRIMIR  guidance  from  HQ  AMC  directed  that  an  EA  should  be  prepared 
for  all  PRIMIRs  which  are  categorized  as  a  New  Start,  a  Late  Start,  or  a 
Significant  Revision  Upward  (SRU).  The  SRU  is  defined  as  a  25  percent  or 
a  $SM  increase  In  the  constant  dollar  estimate  of  program  costs  shown  in 
the  fourth  quarter,  Ti  87  miMIR  submissions.  While  It  Is  apparent  that 
an  RA  should  be  included  in  these  PRIKlR  packages,  it  should  be  noted  that 
an  EA  is  required  when  the  base  case  or  Che  no-accion  alternative  shows 
zero  life'cycle  costs.  The  condition  exists  when  an  item  is  considered 
an  add-on  to  an  existing  system.  In  such  cases,  the  base  case  is  a  non-existing 
alternative  with  no  costs  for  Research  and  Development,  Production  or  Sustainment. 
The  action  caae  is  the  only  real  alternative.  Performing  an  EA  under  such 
circumstances  consumes  needless  manhours  for  developing,  validating  and 
reviewing  the  worksheets.  Preparing  these  studies  can  actually  diminish 
the  significance  of  the  EA  process.  Considering  the  time  constraints  resulting 
from  the  submission  of  PRIMIRs  at  the  MSC  level,  the  preparation  of  unnecessary 
EAs  can  significantly  reduce  the  level  of  review  of  chose  2As  with  viable 
alternatives.  Care  should  be  taken  t  uieolude  Che  decision  maker  from 
concluding  that  economic  analysis  Is  J.  xcess  paperwork. 

In  preparing  PRIMIRs,  the  EA  is  not  required  when  the  action  is  DA-dlrected 
or  is  designated  as  a  safety  PRIMIR.  It  is  Important  that  Che  analysts 
reviewing  the  PRIMIRs  ascertain  whether  these  documents  are  truly  safety 
PRIMIRs.  Virtually  any  acquisition  can  be  construed  as  an  effort  to  improve 
system  safety.  Any  acquisition  which  addresses  a  aafeCy  issue  should  be 
-letrly  stated  in  writing  as  an  approved  safety  PRIMIR.  Appicval  authority 
is  generally  aaevmc'^  ro  be  the  MSC  Safety  Office. 
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Bconowlc  analysl*  is  a  process  which  enables  the  decision  maker  to  evaluate 
cost  estimates  for  competing  alternatives  from  the  current  perspective. 

By  excluding  sunk  dollars,  the  decision  maker  can  select  the  alternative 
which  best  utilizes  all  current  and  future  available  resources.  Cost  analysis 
ttudlef,  Such  as  ROCt  and  LRs,  have  aunk  dollars  excluded  from  the  estimates. 
Economic  analysis  studies  should  be  presented  in  the  same  manner. 

During  the  recent  review  of  PRlMIRs,  it  was  noted  that  sunk  costs  were 
not  extracted  from  the  EAs.  Instead,  sunk  costs  were  displayed  in  the  early 
years  of  the  cost  comparison.  The  incluelon  of  sunk  dollars  into  the  EA 
presents  program  costs  from  an  historical  prospective,  looking  from  the 
viewpoint  of  the  start  of  the  program.  However,  this  historical  view  aefeacs 
the  goal  of  the  decision  maker  which  is  to  review  program  costs  from  the 
current  perspective.  The  Intent  of  EA  Is  not  the  Justification  for  the 
consumption  of  sunk  dollars. 


AVSCOTl  has  developed  an  EA  model  for  PRIMIR  submissions  which  compares 
discounted  doHara  for  the  action  and  the  no-action  alternatives.  This 
model  aerves  the  purpose  of  facilitating  preparation  of  EAs  which  ate  accurate 
and  consistent  with  HQ  AMC  and  HQ  AVSCOM  policy.  Thia  model  displays  Investment 
and  Operating  and  Support  costa,  discounts  these  dollars,  and  computes  the 
Uniform  Annual  Cost  (UAC). 

However,  only  Operating  and  Support  (O&S)  costs  are  rolled  up  on  the 
EA  coat  comparison  sheet.  While  the  differential  O&S  costs  are  computed 
and  discounted,  Investaant  dollar*,  are  excluded  from  the  comparison.  The 
best  methodology  for  implementing  economic  analysis  is  to  develop  cost  estimates 
that  compare  total  program  costs  which  are  not  sunk.  In  many  situations, 
the  inclusion  of  Investment  dollars  will  tip  the  balance  in  favor  of  a  different 
alternative. 

Operating  and  Support  costs  are  not  only  a  large  percentage  of  the  total 
program  costs  for  most  systems,  in  recent  years  these  costs  have  been  receiving 
increasing  attention.  In  reviewing  O&S  costa,  it  is  essential  to  question 
the  source  and  the  methodolcgy  employed  in  deriving  these  pro jectior.s . 

O&S  costs  are  the  only  costs  shown  on  the  cost  comparison  work  sheet  of 
the  EA  for  the  PRIMIR  submissions.  Consequently,  a  consistent  set  of  assumptions 
must  be  applied  to  each  alternative  when  estimating  these  costs.  A  reasonable 
and  accurate  bottoa-line  cost  comparison  can  only  be  obtained  when  reasonable 
and  accurate  cost  data  Is  input  into  the  model. 

A  significant  calculation  in  EA  submissions  is  the  determination  of 
the  uniform  annual  cost.  The  UAC  is  calculated  by  dividing  the  sum  of  the 
discounted  annual  costa  by  the  sum  of  the  discount  factors  for  the  years 
In  which  benefits  are  received.  The  UAC  is  one  of  the  best  determinants 
In  compering  cost  estimates  for  several  altsmatlves. 
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Ir  rtvlewing  the  uniform  annuel  coat,  it  is  essential  chat  a  consistent 
definition  of  benefits  be  applied  to  each  alternative.  A  PRIMIR  recently 
aubaitted  to  the  AVSCOM  CECDC  office  for  validation  showed  a  UAC  value  for 
one  alternative  as  being  approximately  three  times  Chat  for  another  alternative 
while  the  total  diacounted  dollar  estimates  varied  by  only  a  few  per  cent. 

An  analyala  of  this  discrepancy  revealed  a  varying  definition  of  benefits. 

In  the  no-change  alternative,  the  benefits  were  assumed  to  begin  in  the 
first  year  of  the  existing  program,  while  the  action  alternative  showed 
benefits  connencing  in  the  first  year  of  acquisition  of  the  new  system. 

The  problem  was  identified  as  the  definition  of  benefit  years.  It  was  determined 
that  the  benefits  for  the  second  alternative  should  also  start  in  the  first 
year  of  the  existing  program  since  this  alternative  involved  the  phasing-in 
of  a  replacement  ayatem.  Benefits  were  derived  from  the  existing  system 
prior  to  the  Commencement  of  the  new  program.  Each  UAC  calculation  should 
always  include  a  review  of  the  definition  of  the  benefit  years. 

Special  Considerations 

The  Department  of  Defense  has  employed  an  unchanging  ten  per  cent  discount 
rate  for  many  years.  This  value  haa  remained  constant  through  periods  of 
low  inflation  and  high  inflation  and  through  periods  of  low  prime  lending 
rates  and  high  prime  rates.  This  inflexibility  in  the  discount  race  has 
undoubtedly  led  many  to  question  the  value  of  using  the  discounted  dollars 
for  comparing  alternatives.  Any  change  in  discount  factors  will  alter  the 
discounted  dollar  projections  and  could  tilt  the  balance  to  favor  a  competing 
alternative  for  certain  programs. 

An  important  issue  surfaced  during  the  recent  PRIMIR  submissions.  Why 
are  the  economic  analyses  not  forwarded  to  higher  headquarters  for  review? 

In  addition  to  consideration  of  the  manhours  expended  preparing,  validating 
and  reviewing  the  subject  documents,  the  EA  should  be  an  essential  part 
of  any  program  review.  Decision  makers  should  have  access  to  validated 
economic  analysis  studies  to  ensure  Che  most  efficient  use  of  program  resources. 
Under  current  guidance  fewer  than  twenty  per  cent  of  the  PRIMIRs  should 
require  an  EA.  Can  time  constraints  be  responsible  for  the  exclusion  of 
EAs  from  the  PRIMIR  review  process?  Furthermore,  does  higher  headquarters 
review  EAs  when  these  studies  are  not  part  of  a  PRIMIR  package? 

Another  vital  issue  involving  economic  analysis  concerns  the  integrity 
of  Che  process  itself.  The  use  of  various  models  to  generate  economic  analyses 
facilitates  increased  office  productivity  and  efficiency.  Fewer  arithmetic 
mistakes  occur.  However,  utilization  of  such  models  could  invite  abuse. 

A  program  manager  who  favors  a  particular  alternative  could  easily  manipulate 
the  model  entering  varying  input  data  until  the  desired  result  is  obtained. 
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Thii  input  data  could  be  engineering  eatlmatea,  euch  as  failure  rates,  RAM 
factors,  cost  estiaateS,  etc.  Sometimes,  a  snail  change  In  an  Input  variable 
can  result  in  a  substantial  alteration  in  the  output,  such  as  a  spares  requirement. 
This  could  lead  a  decision  aa'/er  to  choose  the  "preselected"  altsrnstlvc. 

Decision  makers  need  to  ascertain  the  reasonableneaa  of  the  key  input  data. 

A  skeptical  reviet’er  may  aak  how  often  the  economic  analysis  model  was  run 
to  secure  the  desired  result.  A  sensitivity  analysis  will  reveal  the  impact 
of  variations  of  the  input  data  on  the  output  results. 

Recommendations 


1.  When  submitting  an  EA,  a  benefit  analyala  should  be  prepared  with  the 
cost  analysis.  Linking  cost  and  benefit  analysis  into  a  joint  comparison 
may  be  difficult  to  accomplish.  Any  reasonable  effort  to  present  a  combined 
cost'^er.'f it  analysis  should  be  encouraged. 

2.  An  EA  should  not  be  required  when  no  viable  alternative  exists. 

3.  Ensure  that  all  PRIMIRs  which  are  categorized  as  safety  PRIMIRs  are 
certified  as  such  by  the  appropriate  MSC  office. 

4.  Sunk  costs  should  be  excluded  from  EA  cost  comparison  worksheets.  Such 
costs  may  be  displayed  on  a  separate  line  or  footnote  provided  that  these 
coats  are  not  rolled  into  the  cost  comparison. 

5.  Development  and  Production  costs  should  be  included  with  Operating  and 
Support  Costs  on  the  £A  cost  comparison  worksheet.  All  program  costs  which 
are  not  considered  sunk  should  be  presented  in  the  cost  comparison. 

6.  Operating  and  Support  costs  should  be  reviewed  carefully  since  these 
costs  represent  a  substantial  portion  of  the  life  cycle  cost  estimate. 

The  source  document  for  the  O&S  cost  estimate  should  be  stated  on  the  EA. 

7.  Analysts  should  check  the  UAC  values  to  ensure  that  the  costs  are  determined 
properly  considering  the  scheduled  benefit  years.  It  Is  Imperative  that 

a  consistent  definition  of  benefit  year  be  applied  to  each  alternative. 

8.  DOD  discount  rates  should  be  adjusted  when  economic  conditions  Indicate 
that  such  action  would  be  reasonable  and  justifiable.  One  suggestion  would 

be  to  require  DOO  to  review  the  discount  rate  on  an  annual  basis.  Any  adjustment 
to  the  standard  ten  per  cent  rate  could  be  published  ir.  conjunction  with 
the  dissemination  of  Inflation  guidance.  If  economic  conditions  warrant 
additional  changes  to  the  rate  during  a  particular  year,  then  DCO  could 
Issue  revised  rates  as  deemed  necessary. 

9.  Any  economic  analysis  which  is  required  by  higher  headquarters  for  subBtssion 
within  the  PRIMIR  packages  should  be  forwarded  to  higher  headquarters  for 
review. 

10.  Decision  makers  should  scrutinize  key  Input  data  used  In  EA  models 

to  generate  cost  estimates.  A  sensitivity  analysis  should  demonstrate  the 
impact  which  adjustments  to  the  Input  date  have  on  the  output  cost  data. 
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Concluiion 


Economic  analysis  provides  Che  means  vhlch  enables  Che  decision  maker 
to  sclecc  Che  best  alternative  at  any  point  in  time  In  the  program  acquisition 
cycle.  However,  misuse  of  economic  analysis  may  involve  mlsrepresencaclon 
of  input  data,  miscalculation  of  costa,  misincerpretaclon  of  results,  and 
even  misunderstanding  of  the  purpose  of  performing  the  EA  si-udy.  Proper 
application  of  EA  techniques  will  factllCate  optiital  utilization  of  scarce 
DOD  resources. 
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ACRONYMS 


AMC 

Amy  Materiel  Cosmand 

AVSCOM 

Aviation  Syatema  Coamand 

CECDC 

Cost  Estimate  Control  Data  Center 

DOD 

Department  of  Defense 

£A 

Economic  Analysis 

HQ 

Headquarters 

LR 

Letter  Requirement 

HSC 

Major  Subordinate  Command 

OAS 

Operating  and  Support 

PRIMIR 

Product  Improvement  Management 

Infomation  Report 

RAM 

Reliability,  Availability,  and  Maintainability 

ROC 

Required  Operational  Capability 

SRU 

Significant  Revision  Upward 

UAC 

Uniform  Annual  Cost 
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